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PATENT 



AMENDMENT 




Assistant Commiasioner for Patents 
Washington, D.C* 20231 



Sir: 



Please make the following amendments to this application. 



AMENDMENTS 

In tb^ Description : 

ReWrite the paragraph beginning on page 5, line 4, to read as 
follows: 

Kalman tracking applies a Newtonian motion model to the centroids 
of the objects of interest. As an example, the objective is to track 
object #K in Fig. 3, whose location in the starting frame I 0 of the 
input video image sequence is identified by the user. Object #K 
belongs to color model #A while a different object #L belongs to color 
model #B, The user "clicks" on the estimated location of the centroid 
(geometric center) of the object #K and thereby identified the object 
#K as an object of interest. The Kalman state vector at time "n" is: 



x k [n] 
Yictn] 
[n] 



[n] 



where (x^, y fc ) are the location coordinates of the centroid for object 
#K, and (v x)f , v yK ) are the velocity components of object #K, The 
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(7- 7^ 

Newtonian motion model for all objects assumes that acceleration is a 
white-noise process. This motion model is well known in the art and 
may be found in the liLerature on Kalman filtering. 



Rewrite the paragraph beginning on page 7, line 17, to read as 
follows : 



For the initialization of the process the position of the 
centroid in frame I 0 , [o|o], is determined. The user "clicks" near 
the visually estimated geometric center of the object #K, and that 
point serves as the initial position. The initial velocity is set to 
zero. Then values for R**, and £ k [Q|0] are determined 
experimentally and used to determine the centroid position. One such 
set is 

Et 8 - |2-0, 0; 0, 8 . 0 1 ; R^ 0 = |l, 0; 0, 2|; £ k [o|0] = |l.6, 0, 0, 0; 0, 

3.2, 0, 0; 0, 0, 2.0, 0; 0. 0, 0, 4 - 0 1 
- 

Rewrite the paragraph beginning on page 8, line 9, to read as 
follows ; 

Sometimes, due to the geometric shape of the object or due to 
sudden changes an acceleration, the Kalman prediction points to a 
centroid location that is outside the houndary of the object #K, as 
shown in Fig. S. This situation arises when the PxQ block that 
contains the predicted centroid position is classified by the color 
segmentation algorithm as belonging to a class other than color model 
#A. Again this situation is easily detected. To recover from this, 
search around a local neighborhood of the predicted centroid position. 
As shown in Fig. 6, begin at the PxQ block that contains the predicted 
centroid position and examine PxQ blocks in a spiral search pattern 
until one is found that belongs to color model #A. Then grow a 
connected region around this block and label it as object #K in frame 
I n *i* radius of the spiral search is a parameter that may be 

adjusted for each input video image sequence. If the objects of 
interest move slowly and are "convex" in shape , then a small search 
radius, such as a 5x5 neighborhood, is generally sufficient. rf there 
is rapid and random motion, then a larger search range is desired. 
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Rewrite the paragraph beginning on page 9, line 16 , to read as 
follows: 

For option (I) the color segmentor outputs a segmentation map 
S D , a . See Fig. 8. Sach sample in S uia represents a spatially 
corresponding PxQ block of frame I n+1 . The value of the sample "n w is 
{0 P 1,.,,, N u }, where {l,..., N u } are the color models provided to the 
color segmentor and {o} represents "garbage". The segmentation map is 
converted to a binary alpha map 0f O4l by tagging all samples aa S n+l that 
have the same color model as object #K, Thus pixels in oi^ l have a 
value 255 if their corresponding PxQ block in I nil has the same color as 
object #K, and have a value of 0 otherwise. The alpha map is fed to a 
"grow connections" algorithm (Fig. 9) along with the block coordinates 
of the predicted position of the centroid of object #K. The output is 
the desired connected region that is tagged as the object of interest. 
A simple error recovery scheme begins by detecting all connected 
regions in frame I n+1 that have the same color as object #K, and then 
Belects the biggest one among them. 



REMARKS 

The amendmeiiLs Tor the paragraphs starting at page 5, line 4, and 
page 9, line 16, are for clarification. The amendments for the 
paragraphs starting at page 7, line 17, and page 8, line 9, are for 
correction of obvious errors. 
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